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ABSTRACT 

Two psychometric approaches for ths investigation of 
item bias were employed to examine the performance of four 
sociocultural groups on six subtests of the Wechsler Intelligence 
Scale for Children - Revised (WiSC-R). The sample of 950 students was 
from Pima County, Arizona. One approach involved the comparison of 
the psychometric indices of internal consistency reliability, which 
were reasonably high and comparable for the four groups; the rank 
order correlations of item difficulty, which were quite high and 
comparable for the four groups; and the rank order correlations of 
the differences in the difficulty of adjacent items, which were less 
comparable for Native American Papagos suggesting possible items by 
group interactions. A second approach involved the utilization of 
transformed item difficulties and a quantitative method of outlier 
analysis to identify specific items as biased (i.e., as manifesting 
an item by group interaction). Results were not interpreted as 
evidence of cultural bias, however, since the possible confounding 
effects of socioeconomic status and overall ability were not 
controlled. Further, the items identified did not appear to reflect 
aspects of the assumption of "interference" implicit in the notion of 
cultural bias. (Author/PN) 
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ABSTRACT 

Two psychometric approaches for the investigation of item bias were employed 
to examine the performance of four sociocultural groups on six subtests of 
the Wechsler Intelligence Scale for Children - Revised (WISC-R). The sample 
of 950 students (Anglo N = 252; Black N = 237; Chicano N =223; and Native 
American Papago N = 238) was from Pima County, Arizona. The subtests analyzed 
were the five Verbal Scale subtests of Information, Similarities, Arithmetic, 
Vocabulary, and Comprehension and the Performance Scale subtest of Picture 
Completion. One approach involved the comparison of the psychometric indices 
of internal consistency reliability which were reasonably high and comparable 
for the four groups, the rank order correlations of item difficulty which 
were quite high and comparable for the four groups, and the rank order corre- 
lations of the differences in the difficulty of adjacent items which were 
less comparable for Native American Paoagos suggesting possible items by 
group interactions. A second approach involved the utilization of trans- 
formed item difficulties and a quantitative method of outlier analysis to^ 
identify specific items as biased (i.e., as manifesting an item, by group in- 
teraction). No items were identified as biased against Blacks on any of the 
subtests. Only one item was identified as biased against Chicanos. No items 
were identified as biased against Native American Papagos on the Performance 
subtest. Picture Completion, but nearly one-third of the items on the Verbal 
subtests were so identified. A majority of the items on the six subtests 
were slightly more difficult for the Black, Chicano, and Native American 
Papago groups than for the Anglo group. These results were not interpreted 
as evidence of cultural bias, however, since the possible confounding ef- 
fects of socioeconomic status and overall ability were not controlled. Fur- 
ther, the items identified did not appear to reflect aspects of the assump- 
tion of "interference" implicit in the notion of cultural bias. 
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INTRODUCTION 



Allegations of cultural bias against Black, Hispanic, and Native Ameri- 
can children in individually administered intelligence tests have been made 
both in the academic literature (Gav & Abrahams, 1973; Laosa, 1977; Mercer 
& Brown, 1973; Williams, 1971, 1975) and by plaintiffs in court cases (Diana 
v. California State Board of Education, 1970; Guadalupe y. Tempe School Dis- 
trict, 1971; Larry P. v. Riles, 1972, 1974, 1979; PASE v. Hannon, 1980). 
Those alleging cultural bias have often done so on the basis of their judg- 
ment that the domain sampled by intelligence tests has been restricted to 
the experiences of white, middle class groups. "American IQ" tests have, in- 
evitably, included items and procedures which reflect the abilities and 
skills valued by the American core culture. This *core culture' consists 
mainly of the cultural patterns of that segment of the population consisting 
of white, Anglo-Saxon Protestants whose social status today has become middle 
and upper middle class" (Mercer & Brown, 1973, p. -66). 

A variety of empirical investigations of cultural^ bias have been made 
using different definitions of bias, different tests, and different popula- 
tions. The majority have focused upon tests used for the selection of can- 
didates for college admission or employment with adolescent and adult popula- 
tions. Studies using individual intelligence tests with children have by and 
large been investigations of atmosphere bias (Sattler, 1974). Substantially 
fewer studies have been made of item bias, especially on individual intelli- 
gence tests with this age group. 

Empirical investigations of item bias on the Wechsler Intelligence Scale 
for Children - Revised (WISC-R) (Wechsler, 1974) are needed on a number of 
grounds. First, as Judge Peckham observed in his Opinion (Larry P. v. Riles, 
1979), there is a lack of information upon which to base a decision regarding 
this test. Secondly, there has been a tendency among those alleging cultural 
bias to select specific items for criticism in order to indict the entire 
test. For example, Item 6 on the WISC-R Comprehension subtest ("What is the 
thing to do if a boy/girl much smaller than yourself starts to fight with 
you?") has often been cited as biased against black children (APA Monitor, 
1977; Williams, 1975). As a matter of fact. Judge Peckham relied upon this 
criticism in his Opinion. "Cultural differences can also be found in spe- 
.cific test items. Some of these items have in fact become rather notorious, 
such as the 'fight item* on WISC tests.' This question asked children what 
they would do if struck by a smaller child of the same sex. The 'correct* 
* answer is that it is wrong to strike the child back... Similarly, it may be 
that such questions as who wrote Romeo and Juliet, who discovered America, 
and who invented the light bulb, are culturally biased" (Opinion, Larry P. v. 
Riles, 1979, p. 48). 

Two approaches have principally been employed in empirical research on 
item bias. One approach, elaborated by Arthur Jensen (1978; 1980), involves 
the comparison of selected psychometric features of a test such as the inter- 
nal consistency reliability, the item correlation with total score, the rank 
order of item difficulties, and the relative difficulty of adjacent items. 
These psychometric characteristics would be expected to be similar of the 
test functioned the same for the grdups under comparison. Bias would be 
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suspected if these psychometric properties were different for the groups in 
question." The second" approach , associated primarily with the process of 
test construction, includes a variety of methods that have been developed 
for identifying specific items as biased. One method incorporates subje*.- 
tive judgment by hardng panels of experts scrutinize the items to detect 
biased content. Un#Runately, the degree of agreement among the experts 
has tended to be very low (Flaugher, 1978; Jensen, 1977). Among the other 
methods of analyzing item bias, the principal ones may be designated as: 
transformed item difficulty (Anastasi, 1976); correlational (Green & Draper, 
1972 cited in Merz & Rudner, Note 1); chi square (Scheuneman, 1979J; item 
characteristic curve (Lord, 1977 and others cited in Merz & Rudner, Note U; 
and distractor response analysis (Veale & Foreman, 1975, 1976 cited in Merz 
& Rudner, Note 1). An analysis of variance framework has also been used to 
investigate bias defined as an item by group interaction with test items and 
group membership considered main effects (Angoff & Ford, 1973; Cleary & 
Hilton, 1968). This method has not permitted the identification of specific 
items as biased, however, unless accompanied by numerous a priori comparisons 
or post hoc tests (Merz & Rudner, Note 1). 

These methods have typically been employed with large samples and group- 
administered tests on which it may be assumed that all examinees have had an 
opportunity to respond to all items. Of those mentioned, the transformed 
item difficulty method is probably the oldest and best known (Anastasi, 1975j. 

According to the transformed item difficulty method, a specific item is 
considered biased if it appears relatively more difficult for one group than 
another, i.e., if there is an item by group interaction visible on a scatter- 
plot. Merz and Rudner (Note 1) suggest that biased items be identified quan- 
titatively by means of an' outlier analysis. One method of outlier analysis 
that they describe involves setting a fixed boundary of .75 z-score units. 
Outlying items beyond this boundary are considered biased. 

Only one study of item bias on the WISC-R har been published previously 
(Sandoval, 1979). Analyzing WISC-R data obtained in the standardization of 
the System of Multicultural Pluralistic Assessment (Mercer, 1979), Sandoval 
reported that: 1) the Cronbach Alpha coefficients indicated^high and compar- 
able internal consistency reliabilities for the Anglo, Black, and Chicano • 
groups on all of the subtests; 2) using item means as a measure of item dif- . 
ficulty, the rank order correlations of item difficulties and of the differ- 
ences in adjacent item difficulties were all quite high; 3) the amount of 
variance attributable to the item by ethnic group interaction (an indicator 
of bias) and to the item by SES within ethnic group interaction was generally 
small, biit statistically significant, particularly on the Verbal subtests; 
and 4) a total of 97 items were identified as most discriminatory between the 
Anglo and Black or Chicano groups in a Multivariate Analysis of Variance. 
Sandoval concluded that "In general the notion that there may be a number of 
" items with radically different difficulties for children from different 
ethnic groups has not been supported... The lack of a clear pattern of dif- 
ficult items and the fact that there exist a large number of items just 
slightly more difficult for minority group children spread throughout the 
entire test suggests that general factors rather than specific item content 
contribute to differences in means" (Sandoval, 1979, p. 925). 
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The purpose of this study, like the one by Sandoval, was the ompirical 
investigation of item bias on the WISC-R. The present study was different 
in that the performance of a group of Native American children was examined 
as well as the performance of groups of Anglo, Black, and Chicano children. 
In addition, the method varied in that transformed item difficulties and a 
method of outlier analysis for the identification of biased items were ap- 
plied to the data. However, some of the analyses were similar in the two 
studies permitting a comparison of the results. 

The basic design of this study incorporated methods representative of 
the two principal approaches to the- investigation of item bias reported in 
the literature. Accordingly, two major questions were addressed. First, 
were such psychometric properties as the internal consistency reliability, 
the rank order of .item difficulty, the differences in the difficulties of 
adjacent items, and the correlations between item performance and subtest 
score similar for the four groups? Second, using transformed item diffi- 
culties and a method of outlier analysis for the identification of biased 
items^ which and how many .items were so identified? 



METHOD 

The data were collected in the Pima County Prevalence Study which has 
been described in detail by Reschly and Jipson (1976). A random sample of 
1,040 children was selected from enrollment rosters of all schools in Pima 
County, Arizona. Equal representation was given to ethnic group (Anglo, 
Black, Chicano, and Native American Papago N = 260), grade level (1st, 3rd, 
5th, 7th, and 9th), and sex. The final sample sizes were 252 Anglos; 237 
Blacks; 223 Chicanos; and 238 Native American Papagos. The scores of all 
twelve subtests of • the WISC-R were obtained for each child. The WISC-R 
was administered by appropriately trained examiners, and all protocols were 
checked for clerical and scoring errors. 

The Wechsler Intelligence Scale for Children - Revised was published in 
1974 (Wechsler, 1974). The instrument has been extensively reviewed by 
Sattler (1982). The administration and scoring procedures are clearly de- 
tailed in the Manual (Wechsler, 1974). The analyses which follow had to take 
into account two particular facets of the administration and scoring of the 
WISC-R. Specifically, all subjects did not receive all items, and responses 
were not scored on a simple right/wrong, 1 or 0, basis. As a consequence, 
the only Performance subtest included was Picture Completion. The p-values 
(percentage passing each item) were obtained by dividing the number passing 
the item by the total number of subjects since the subjects would not have 
received credit for items beyond their discontinue points according to stan- 
dardized scoring procedures. Finally, for the Verbal subtests. Similarities, 
Vocabulary, and Comprehension, passing was arbitrarily defined as a score of 
1 or more. ' 

The data were analyzed as follows: 
1: The raw score means and standard deviations for each group were calcu- 
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lated for each subtest and for the Verbal and Performance scales (with 
Mazes substituted for Coding). 

2. Internal reliability coefficients were calculated using Cronbach Alpha 
for each of the four groups for 10 of the 12 subtests (Coding and Digit 
Span not included). 

3. For the subtests. Information, Similarities, Arithmetic, Vocabulary, 
Comprehension, and Picture Completion, p-values were calculated for 
each of the four groups, Anglos, Blacks, Chicanos, and Native American 
Papagos. The items on each subtest were assigned ranks according to 
p-values. Rank order correlations (Spearman Rho) of p-values between 
the four groups were then calculated. 

4. Differences in the p-values of adjacent items for each group were com- 
puted for the six subtests, and rank order correlations (Spearman Rho) 
of these differences were then calculated. 

5. According to the transformed item difficulty method, p-values were trans- 
formed to z-values and then to delta values using a linear trans fortfiati on 
(4z + 21) to eliminate the negative signs. A low delta value thus indi- 
cated a relatively easy item. A high delta value indicated a more diffi- 
cult item. Delta values ranked from 1 (100% passing) to 41 (0% passing). 
Given the administration and scoring rules of the WISC-R in which subjects 
received credit for items below their entry point and did not receive 
credit for items beyond their discontinue point, the items with average 
values for the four groups corresponding to more than 95% passing and 
fewer than 5% passing were arbitrarily eliminated. These items were 
considered subject to basal and ceiling effects. 

6. Pairs of delta values for each of the remaining items were then plotted 
on graphs. Three scatterplots , comparing the delta values of the Anglo 
group with those of the BlaCk, Chicano, and Native American Papago groups, 
were prepared for each subtest. A 45° line was drawn through the origin 
on each scatterplot to represent a theoretical regression line of equal 
item difficulties for the two groups. 

7 Biased items were defined as those exhibiting an item by group interaction 
and were identified by means of an outlier analysis. The items with av- 
erage z-values for the four groups corresponding to more than 95% passing 
and" fewer than 5% passing were not included in this analysis since these 
items typically were not administered to the vast majority of participants. 
The distance of each item point to the 45 theoretical regression line was 
calculated using the equation d = (z, - Zo) / \/^ in which z. was the z- 
value of the item difficulty for groiip j. Outlying items at a- distance 
greater than .75 were categorized as biased (Merz & Rudner, Note 1). The 
Anglo group was taken as the basis for comparison since the WISC-R has 
been characterized as reflecting Anglo culture. 

8. The point biserial correlations between item performance and raw subtest 
score were determined for the subtests of Information, Arithmetic, and 
Picture Completion for each group. The overall pattern of the correla- 
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tions was compared, and the character of the correlations for the items 
identified by the previous analysis as biased was considered. Items 
with point biserial correlations above .40 were judged to be discrim- 
inatinr) well . 



RESULTS 

Means and Standard Deviations 



Table 1 presents the means and standard deviations of the raw scores for 
the four sociocul tural groups on all subtests and the Verbal and Performance 
Scales. The standard deviations on all subtests were quite comparable, 
though generally lower for Blacks, Chicanos, and Papagos on the Verbal sub- 
tests. However, the differences in the standard deviations among the ^oyr 
groups were slight, except on the Vocabulary subtest. The standard deviation 
for the Anglo group on Vocabulary was one-third larger than the standard dev- 
iations of the other three groups. On all of the subtests, the means were 
lower for the Black, Chicano, and Papago groups by at least one-half of the 
standard deviations of the Anglo group. 

Table 1 

Raw Score Means and Standard Deviations 



Anglos Blacks Chicanos Papagos 

Mean S.D. Mean S.D. Mean S.D. Mean S.D. 



Information 


14 


.76 


5.74 


11. 


43 


4.76 


11 


.25 


4.89 


9. 


76 


3.84 


Similarities 


13 


.74 


5.91 


10. 


47 


5.41 


10 


.00 


5.33 


7. 


32 


4.51 


Arithmetic 


11 


.60 


3.32 


10. 


14 


3.37 


10 


.17 


3.07 


8. 


61 


3.00 


Vocabulary 


31 


.40 


12.10 


26. 


11 


9.67 


24 


.18 


9.10 


19. 


29 


8.19 


Comprehension 


18 


.65 


7.60 


15. 


27 


6.80 


14 


.79 


6.50 


10. 


57 


5.69 


Picture 






















59 


4.39 


Completion 


17 


.77 


4.91 


15. 


53 


5.01 


16 


.56 


4.58 


15. 


Picture 




















20. 


61 


10.52 


Arrangement 


26 


.45 


9.52 


20. 


95 


10.72 


21 


.90 


9.75 


Block Design 


27 


.90 


14.98 


19. 


46 


12.43 


22 


.57 


13.91 


21. 


56 


14.19 


Object 

Assembly 


21 


.34 


5.87 


17. 


93 


5.48 


18 


.90 


5.98 


17. 


82 


6.17 


Mazes 


21 


.14 


5.78 


18. 


18 


6.70 


20 


.40 


5.96 


20. 


70 


5.82 


Verbal Scale 


90 


.15 


32.46 


73. 


43 


27.76 


70 


.40 


26.43 


55. 


55 


22.39 


Performance 




















96 


.27 


34.77 


Scalea 


114 


.60 


35.60 


92 


04 


34.12 


100 


.32 


33.86 






N= 


252 




N= 


237 




N= 


223 




N= 


238 



^The Performance Scale was calculated by substituting Mazes for Coding. 
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Internal Consistencies 

As shown in Table 2, the Cronbach Alpha reliability coefficients were 
very comparable for the four groups, and, with one exception (Blacks on 
Block Design) vieYf, higher than the Spearman-Brown coefficients reported in 
the Manual (WechsTer, 1974). On the basis of this analysis alone, it is not 
possible to state whether the coefficients are truly different from one an- 
other either among the four grbups or between the two types of estimates of 
internal reliability. One may observe, however, that the test has reason- 
ably high and comparable reliability for the four groups; and the reliabil- 
ity coefficients reported in the Manual would appear to be appropriate for 
computing the standard error of measurement to be used for all four groups. 

Table 2 



Cronbach Alpha Coefficients 





Anglos 


Blacks 


Chicanos 


Papagos 


Information 


.913 


.893 


.895 


;865 


Similarities 


.853 


.859 


.856 


.825 


Arithmetic 


.848 


.862 


.839 


.842 


Vocabulary 


.927 


.904 


.893 


.882 


Comprehension 


.900 


.891 


.882 


.848 


Picture Completion 


.892 


.892 


.866 


.852 


Picture Arrangement 


. 786 


.840 


.784 


.817 


Block Design 


.873 


.842 


.864 


.871 


Object Assembly 


.797 


.711 


.748 


.737 


Mazes 


.722 


.796 


.743 


.703 



Average reliability coefficients across age groups presented in man- 
ual: calculated according to Spearman- Brown formula for' split-half 
reliability 



Information 


.85 


Similarities 


.81 


Arithmetic 


.77 


Vocabulary 


.86 


Comprehension 


,77 


Picture Completion 


.77 


Picturr Arrangement 


.73 


Block Design 


.85 


Object Assembly 


.70 


Mazes 


.72 



Rank Order Correlations 

The rank order correlations (Spearman Rho) of p-values displayed in 
Table 3 reveal the deqree to which the ordering of item difficulties was 
similar for the four groups on the subtests of Information, Similarities, 
Arithmetic, Vocabulary, Comprehension, and Picture Completion. The corre 
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lations were all quite high, the lowest being .97 between Anglos and Blacks 
on Comprehension. 

Table 3 

Rank Order Correlations of o-values 





Anglos x 
Blacks 


Anglos x 
Chicanos 


Anglos x 
Papagos 


Blacks X 
Chicanos 


Blacks X 
Papagos 


Chicanos x 
Papagos 


Information 


.983 


.988 


.987 


.992 


.984 


.988 


Similarities 


.985 , 


.988 


.99r3 


.990 


.988 


.992 


Arithmetic 


.991 


.991 


.985 


.996 


.991 


.992 


Vocabulary 


.992 


.988 


.989 


.986 


.983 


.987 


Comprehension 


.970 


.976 


.973 


.982 


.986 


.994 


Picture 


.991 


.987 


.978 


.991 


.986 


.990 


Completion 














^A score 


of 2 or 1 


was considered a passing score 







While the p- values appeared to be in much the same rank order for the 
four groups, the differences in the p-values of adjacent items did not. The 
rank order correlation of differences in the p-values of adjacent items* given 
in Table 4 were lower thin the rank order correlations of p-values presented 
earlier. These correlations suggest that the progression of difficulty was 
not quite as smooth as the rank order correlations of p-values would imply, 
particularly for Papagos, and that there were possible item by group inter- - 
actions. 

Table 4 

Rank Order Correlations of Differences in Adjacent p-values 





Anglos x 
Blacks 


Anglos x 
Chicanos 


Anglos x 
Papagos 


Blacks X 
Chicanos 


Blacks X 
Papagos 


Chicanos x 
Papagos 


Information ., 


.41 


.66 


.49 


.74 


.48 


.75 


Similarities'* 


.74 


.68 


.55 


.69 


.65 


.86 


Arithmetic 


.84 


.78 


.57 


.81 


.69 


.55 


Vocabulary 


.57 


.68 


.39 


.56 


.58 


.44 


Comprehension 


.74 


.85 


.51 


.68 


.67 


.74 


Picture 


.69 


.46 


.21 


.80 


.53 


.48 


Completion 














^A score 


of 2 or 1 


was considered a passing score 







Transformed Item Difficulties 

The item difficulties (p-values) transformed to delta values may be dis- 
played on scatterplots. The scatterplots for information are illustrative 
(see Figure 1). Each point represents an item. The delta values of the items 
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for Anglos/are given on the abscissas, and for Blacks, Chicanos, and Papa- 
qos on tb^ ordi nates. A line drawn through the origin at a 45 angle rep- 
resents points of equal item difficulty for the groups pictured. 

The points representing the item difficulties for the groups on Infor- 
inaiion occur at or above the equal time difficulty line signifying that all 
<Jf the items were relatively more difficult for Blacks, Chicanos, and Papa- 
'gos than for Anglos. Nevertheless, straight ^lines could be ptted to the 
points to express linear relationships which would be consistent with the 
high rank order correlations of p-values. Table 5 lists the items with 
average delta values for the four groups correponding to p-values of more 
than 95% passing and fewer than 5% passing which were eliminated from further 
consideration since they were considered subject to basal and ceiling etrecto 
and, in fact, were not administered to most participants. 

Table 5 

Items Eliminated^ 



Information Items 1, 2, 3, 25, 26, 27, 28, 29, 30 

Similarities Items 16, 17 

Arithmetic Items 1, 2, 3, 5, 18 

Vocabulary Items 1. 2, 3. 4, 5, 6, 25, 28, 29. 30, 31, 32 

Comprehension None 

Picture Completion Items 1, 2, 3, 4, 26 



^Items with delta values corresponding to more than 95% passing or 
fewer than 5% passing 



Outlier Analysis 

Table 6 summarizes the results obtained by employing a method of outlier 

Table 6 

a 

Outlying Items . 



Anglos x Anglos x Anglos x 
Blacks Chicanos Papagos 



Information None None Items 7, 13, 15, 16, 17, 18, 19, 20, 

21, 22, 24 

Similarities None . None Items 10, 11, 12, 13, 14 

Arithmetic None None Items 6, 13, 15, 17 

Vocabulary None Item 22 Items 15, 16, 17, 8, 9, 22, 24, 27 

Comprehension None None Items 10, 11, 12, 13, 14, 16, 1/ 

Picture Completion None None None 



'items at a distance greater than .75 where distance equals (z^ - z^l 
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Figure 1 

Scatterplots of Transformed Item Difficulties 
on the Information Subtest 




Anglo item difficulty 
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analysis. The outlying items were ones which were more difficult by a 
fixed amount for the Black, Chicano, or Papago groups than for the Anglo 
group. According to the criterion established for this analysis, these 
items would be categorized as biased. None of the items was identified 
as biased against Blacks, and only one item was categorized as biased 
against Chicanos (Item 22 on Vocabulary). On the other hand, nearly one- 
third of the items included in this analysis would be considered biased 
against Papagos. All of the items identified by this analysis were items 
on Verbal subtests, and the majority were items in the latter portions of 
the subtests. Three items, however, were among the earlier items of their 
respective subtests (Items 7 and 13 on Information and Item 6 on Arithmetic). 



Point Biserial Correlations 

Point biserial correlations were computed for the subtests of Informa- 
tion (Table 7), Arithmetic (Table 8), and Picture Completion (Table 9), as 
these are the only subtests on which all items are scored 1 or 0, 

The correlations followed a similar pattern for all four groups on each 
of the three subtests. The correlations which were quite low for the begin- 
ning items, increased steadily to a p^ak on items in the middle portions of 
the subtests before dropping to fairly low points again on the upper extreme 
items. The low correlations on the extreme items indicate that the differ- 
ences in average raw scores on the subtests were small between those who 
passed and those who failed these items. The items which were eliminated 
clearly had extremely low correlations with total subtest scores as would 
be expected since these items were passed or failed by 95% of the partici- 
pants. Nevertheless, at least half of the items on the three subtests were 
discriminating well for the four groups with point biserial correlations 
above .40. 

The correlations were lower for Papagos on Items 13, 15, 16, 17, 18, 
19, 20, 21, 22, and 24 of Information and on^ Items 13, 15, and 17 of Arith- 
metic which were identified as outliers by the previous analysis. The lower 
point biserials indicate that these items were becoming more difficult for 
Papagos. Since these items were beyond the peaks on their respective sub- 
tests, this would suggest that the Papagos were reaching the ceiling on 
these items. At the same time. Items 13, 15, 16, 17, 18, 19, and 20 on 
Information had correlations with subtest scores above .40, so these items 
were still functioning well. 

Item 7 on Information and Item 6 on Arithmetic identified as biased by 
the previous analysis had relatively high point biserial correlations. Ac- 
cording to the outlier analysis, they demonstrated an item by group inter- 
action in that they were relatively more difficult for Papagos than for 
Anglos. At the same time, these items discriminated quite well between ^ 
those obtaining higher and lower scores. The point biserial correlations 
therefore tend to corroborate the characterization of these items as biased. 
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Table 8 

Point Biserial Correlations for Arithmetic 
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Table's ' 

Point Biserial Correlations for Picture Completion 
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DISCUSSION- 

Cultural bias against ethnic minority persons in individual intelli- 
gence tests has been attributed to the interpretation of test results, to 
factors in the testing situation, and to the individual items which comprise 
the test. Few studies, however, have attempted to examine evidence for item 
bias empirically. 

Only two studies, one by Sandoval (1979) and the present one, have in- 
vestigated item. bias on the WISC-R among children from different ethnic and 
cultural groups. The results of the present investigation for Anglo, Black, 
and Chicano children essentially replicate the findings of Sandoval for 
these three groups. Since these were the only groups in the SandovaT study, 
the results for Native American Papago children in the present study cannot 
be compared. The lower mean performance of Black and Chicano children, the 
high and comparable internal consistency reliabilities for the three groups, 
and the high rank order correlations of item difficulties are very similar 
results in the two studies. The rank order correlations of differences in 
the difficulty of adjacent items are slightly lower than those presented by^ 
Sandoval. The discrepancy may be due to the use of different measures of 
item difficulty. Sandoval used item means as a measure of item difficulty 
whereas p-values were used in the present study. 

The items identified by Sandoval's multivariate analysis as those most 
contributing to the observed differences in ethnic group performance were, 
with few exceptions, items in the middle portions of the subtests. The higher 
point biserial correlations among the middle items on the subtests of Informa- 
tion, Arithmetic, and Picture Completion in the current study are compatible 
with his analysis. 

The preceding analyses are assocfated with the approach to the investi- 
gation of item bias advocated by Arthur Jensen (1978). On the basis of these 
analyses, one would conclude that these overall psychometric characteristics 
of the test were similar for the Anglo, Black, and Chicano groups in both 
studies and thus that the test was not biased. 

The present investigation is the only one to date that has also employed 
transformed item difficulties and a method of outlier analysis for the iden- 
tification of specific items as biased. The definition of bias underlying 
these methods is one of an item by group interaction. Items which are dif- 
ferentially more difficult for one group than another are considered biased. 

The transformed item difficulties indicate that the majority of items on 
the subtests analyzed in the present study are somewhat more difficult for 
Blacks, Chi canos, and Native Americarl Papagos than for Anglos. According to 
the criterion established in the outlier analysis, however, none of the items 
was biased against Blacks. Only one item was so identified for Chicanos. 
However, nearly one-third of the items included in the analysis would be 
considered biased against Native American Papagos. 

Therefore, according to these results, there is no support for the con- 
tention that items on these subtests are biased against Black and Chicano 
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children. In particular, those items frequently selected for criticism, 
such as Item 6 on the Comprehension and "Who invented the electric light 
bulb?" on Information, are not markedly more difficult for Blacks and 
Chicanos. The latter item is jfioticeably more difficult for Papagos, but 
the item "Who discovered America?" is not, contrary to the prediction of 
the critics. However, there is slight support for the notion that the 
Performance subtests may be less biased than the Verbal subtests since no 
item was identified as biased against any group on Picture Completion. 

At the same time, there is evidence of bias among the items of the 
Verbal subtests against Native American Papago children. The biased items 
are, with few exceptions, in sequence in the latter portions of the sub- 
tests. Thus, as t.e items are becoming more difficult for all groups, they 
are becoming even more so for Papagos. However, these items are not substan- 
tially more difficult as can be seen in the scatterplots for Information for 
example. They are only slightly outside the fixed limit of difficulty used 
in the outlier analysis. 

The important question which remains is whether the results obtained by 
employing these methods of identifying biased items constitute evidence of 
cultural bias against Native American Papago children. The greater diffi- 
culty of these items would have to be due solely to cultural/ethnic differ- 
ences for this to be the case. Since cultural differences are associated 
with differences in socioeconomic status in American society, any statement 
regarding item bias due to cultural differences would have to include an 
analysis of the effect of socioeconomic variables. Unfortunately, the sample 
sizes were not large endu"' in the present study to permit the adequate repre 
sentation of different s . ^economic levels for this analysis. The lower 
socioeconomic status of ethnic minorities makes sufficient representation at 
the upper levels difficult to obtain and will limit the possibility of ade- 
quate research on this question. 

Another limitation of the present study is that no analysis was made of 
item difficulty while attempting to equate the groups for le^vels of total 
score. Once again, adequate representation of all groups at the upper score 
levels is a problem. There is also the conceptual difficulty of equating 
groups on total scores which consist of items suspected of bias. 

Finally, there is the issue of whether items identified as biased by 
these methods meet an implicit assumption of those alleging cultural bias 
In specific items. This assumption may be stated as one of interference. 
The teachings of the minority culture are assumed to conflict with the con- 
tent of items to make the learning of the "correct" majority culture response 
more difficult. The results for Papagos, as well as. for Blacks and Chicanos, 
appear to Indicate an overall pattern of greater difficulty. One might spec- 
ulate, therefore, that these results point to a general lack of familiarity 
with the contents of these Items. However, a majority of the items identi- 
fied as biased against Papagos cannot be related to specific aspects of Pap- 
ago culture which would interfere with the correct response. One of the^ 
biased items on information is a possible exception. Item 7 on Information 
involves conceptions of time which may differ in the two cultures (Joseph, 
Spicer, & Chesky, 1949). 
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On the basis of his analyses, Sandoval (1979) concluded that the re- 
sults did not support the allegation of item bias on the WISC-R for Biacks 
and Chicanos. Sandoval based his 'argument on the notion that for bias to 
be present, there would have to be "a number of items with radically dif- 
ferent difficulties for children from different ethnic groups" (Sandoval, 
1979, p. 925). He did not specify the number nor define how "radically 
different" the difficulties should be. The transformed item difficulty 
approach with the accompanying method of outlier analysis used in the pres- 
ent study was intended at least to provide a means of establishing limits 
to define how different the item difficulties needed to be in order to 
characterize items as biased. 

The results of both studies reveal that a majority of items spread 
throughout the entire test are more difficult for children of ethnic minor- 
ity groups. However, as Sandoval pointed out, and as the method of outlier 
analysis operationalized, the existence of differences in item difficulty, 
pe^. se, does not constitute evidence of bias. Furthermore, it is also sug- 
gested here that the presence of item by group interactions on the Verbal 
subtests for Papagos, although necessary, does not provide sufficient evi- 
dence of cultural bias in items in view of the possible confounding effects 
of socioeconomic status and the lack of any demonstrable cultural interfer- 
ence on a substantial number of specific items. 

These results, similar to other studies of bias in tests, suggest neg- 
ligible or no bias against Blacks and Chicanos. The broader concern among 
minority critics, is not just test bias, but rather, how test uSj^ affects 
the lives of children (Reschly, J981). Tests which are unbiasedaccording 
to technical criteria rnay.be us'eful in educational classification and oro- 
gramming. The criticaTissue, however, is the quality of the special pro- 
grams and interventions which sometimes follow test use. 
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